An analytic framework for identifying finite-time 
coherent sets in time-dependent dynamical systems 

Gary Froyland* 
School of Mathematics and Statistics 
University of New South Wales 
Sydney NSW 2052, AustraHa 

October 30, 2012 



Abstract 

The study of transport and mixing processes in dynamical systems is particularly 
important for the analysis of mathematical models of physical systems. Barriers to 
transport, which mitigate mixing, are currently the subject of intense study. In the 
autonomous setting, the use of transfer operators (Perron-Frobenius operators) to 
identify invariant and almost-invariant sets has been particularly successful. In the 
nonautonomous (time-dependent) setting, coherent sets, a time-parameterised family 
of minimally dispersive sets, are a natural extension of almost-invariant sets. The 
present work introduces a new analytic transfer operator construction that enables 
the calculation of finite-time coherent sets (sets are that minimally dispersive over a 
finite time interval). This new construction also elucidates the role of diffusion in the 
calculation and we show how properties such as the spectral gap and the regularity of 
singular vectors scale with noise amplitude. The construction can also be applied to 
general Markov processes on continuous state space. 

1 Introduction 

Transport and mixing processes |36l [11150] play an important role in many natural phenomena 
and their mathematical analysis has received considerable interest in the last two decades. 
Transport is a key descriptor of the impact of the system's dynamics in the physical world, 
and coherent structures and metastability provide information on the multiple timescales of 
the system, which is crucial for efficient modelling approaches. Persistent harriers to trans- 
port play fundamental roles in geophysical systems by organising fluid flow and obstructing 
transport. For example, ocean eddy boundaries strongly influence the horizontal distribu- 
tion of heat in the ocean, and atmospheric vortices can trap chemicals and pollutants. These 
time-dependent persistent transport barriers, or Lagrangian coherent structures, are often 
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difficult to detect and track by measurement (for example, by satellite observations), and 
many coherent structures present in the flow are very difficult to detect, map, and track to 
high precision by analytical means. 

Coherent structures have been the subject of intense research for over a decade, primarily 
by geometric approaches. The notion that geometric structures such as invariant manifolds 
play a key role in dynamical transport and mixing for fluid-like flow dates back at least two 
decades. In autonomous settings, invariant cylinders and tori form impenetrable dynamical 
barriers. This follows directly from the uniqueness of trajectories of the underlying ordinary 
differential equation. Slow mixing and transport in periodically driven maps and flows can 
sometimes be explained by lobe dynamics of invariant manifolds [391 HO]- In non-periodic 
time-dependent settings, finite-time hyperbolic material lines and surfaces, and more gen- 
erally Lagrangian coherent structures (LCSs) [261 EZl HH |29] have been put forward as a 
geometric approach to identifying barriers to mixing. LCSs are material (ie. following the 
flow) co-dimension 1 objects that are locally the strongest repelling or attracting objects. 
In practice these objects are often numerically estimated by a finite-time Lyapunov expo- 
nent (FTLE) field, with additional requirements [29]. Recent work [30] considers minimal 
stretching material lines. 

Probabilistic approaches to studying transport, based around the transfer operator (or 
Perron- Frobenius operator) have been developed for autonomous systems, including [TUl [HI 
[T31 El ESj- These approaches use the transfer operator (a linear operator providing a global 
description of the action of the flow on densities) to answer questions about global transport 
properties. The transfer operator is particularly suited to identifying global metastable or 
almost-invariant structures in phase space [IHl HH [151 [H] . Related methods, which attempt 
to decompose phase space into ergodic components include [H EZ] . Transfer operator-based 
methods have been very successful in resolving almost-invariant objects in a variety of applied 
settings, including molecular dynamics (to identify molecular conformations) ^3], ocean 
dynamics (to map oceanic gyres) [201 E] , steady or periodically forced fluid flow (to identify 
almost-cyclic and poorly mixing regions) [HI HE], and granular flow (to identify regions with 
differing dynamics) [6]. 

In the aperiodic time-dependence setting, the papers [121 [22] introduced the notion of 
finite-time coherent sets, which are natural time-dependent analogues of almost-invariant or 
metastable sets. A pair of optimally coherent sets (one at an initial time, and one at a final 
time) have the property that the proportion of mass that is in the set at the initial time 
and is mapped into the set at the final time is maximal. Thus, there is minimal leakage or 
dispersion from the sets over the finite interval of time considered. The construction in [22| 
is a novel matrix-based approach for determining regions in phase space that are maximally 
coherent over a finite period of time. The main idea is to study the singular values and 
singular vectors of a discretised form of the transfer operator that describes the fiow over 
the finite duration of interest. Optimality properties of the singular vectors lead to the 
optimal coherence properties of the sets extracted from the singular vectors. Moreover, the 
construction enabled the tracking of an arbitrary probability measure, corresponding to an 
arbitrarily weighted fiux. 

Numerical experiments [22| have very successfully analysed an idealised stratospheric fiow 
model, and European Centre for Medium Range Weather Forecasting (ECMWF) data to 
delimit the stratospheric Antarctic polar vortex. The method of [22] has also been success- 
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fully used to map and track Agulhas rings in three dimensions [16] , yielding eddy structures 
of greater coherence than standard Eulerian methods based on a snapshot of the under- 
lying time-dependent flow. These exciting numerical results motivate further fundamental 
mathematical questions. On the mathematical side, the numerical diffusion inherent in the 
numerical discretisation procedure [22] plays a role in the smoothness of the boundaries of 
the sets identified by the method. On the practical side, dynamical systems models of geo- 
physical processes are often a combination of deterministic (e.g. advective) and stochastic 
(e.g. diffusive) components. 

The mathematical framework of [22] is purely finitary, which obscures the important role 
played by diffusion. The present work extends the matrix-based numerical approach of [22] 
to an operator-theoretic framework in order to formalise the constructions in a transfer oper- 
ator setting, and to enable an analytic understanding of the interplay between advection and 
diffusion. This interplay has practical significance as mixing in geophysical models is often 
not resolved explicitly at subgrid scale by the model, but included via a "parameterisation" 
of subgrid diffusion. Studies of ocean models [121 [M] have shown that the thermohaline 
circulation and ventilation rates depend sensitively on subgrid parameter. Similarly, trans- 
port barriers may sensitively depend on subgrid diffusion; indeed the observed sensitivity to 
thermohaline circulation and ventilation rates may be due to sensitivity of hidden transport 
barriers. 

In this work, we formalise the framework of [22] by casting the constructions as bounded 
linear operators; specifically using Perron- Frobenius operators to effect the advective dynam- 
ics and diffusion operators to effect the diffusive dynamics. This operator-theoretic setting 
clarifies the coherent set framework and isolates the important role played by diffusion in the 
computations. As in [22], there are no assumptions about stationarity, in fact, our machinery 
is specifically designed to handle nonautonomous, random, and non-stationary systems. 

The finite-time constructions considered here are to be contrasted with recent time- 
asymptotic transfer operator constructions [181 El], where equivariant Oseledets sub- 
spaces play the role of singular vectors in the present paper. Time-asymptotic (or "infinite- 
time") coherent sets are those sets that disperse at the slowest (exponential rate) over an 
infinite time horizon; numerical calculations may be found in [TH]. In the present paper we 
are specifically interested in sets that are most coherent over a particular finite-time horizon. 

An outline of the paper is as follows. Section 2 states the necessary optimality properties 
of singular vectors of compact linear operators on Hilbert space. In Section 3 we specialise 
the linear operators to transfer operators defined by a stochastic kernel and describe the 
coherent set framework in this setting. Section 4 considers the situation where the transfer 
operators are compositions of a Perron-Frobenius operator with a diffusion operator, and 
demonstrates that the diffusion operator is solely responsible for the subunit singular values. 
Section 5 develops upper bounds for the regularity of the singular vectors as a function of the 
diffusion radius, and develops an upper bound for the spectral gap in terms of the diffusion 
radius. Section 6 contains a case study of a nonautonomous idealised stratospheric flow. We 
numerically demonstrate the effect of diffusion on the spectrum, the singular vectors, and 
resulting coherent sets, and then conclude. 
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2 Singular Vectors for Compact Operators 



Let C : X ^ y he a compact linear mapping between Hilbert spaces. We will shortly 
specialise to the setting where £ is a transfer operator, but for the moment we only make 
use of compactness and the existence of an inner product. Denote A = C*C : X ^ X, 
where C* is the dual of C. Note that A is compact, self-adjoint, and positiv^ and thus the 
spectrum of A is non- negative. Enumerate the eigenvalues of Ai > A2 > ■ ■ • > where 
the number of occurrences equals the multiplicity of the eigenvalue. By the spectral theorem 
for compact self-adjoint operators (see eg. Theorem II. 5.1, [7]), we can find an orthonormal 
basis of eigenvectors ui G X, enumerated so that Aui = XiUi, so that 

M 

A='^\i{-,ui)xui, (1) 

1=1 

where M may be finite or infinite. 

One has the following minimax principle (see eg. Theorem 9.2.4, p212 [2]): 

Theorem 1. 

Xi= min max ^^^^^^,/ = 1,...,M. (2) 

V';codimy</-1<A/O^xey (x, x);^:' 

Furthermore, the maximising xs are the ui, / = !,..., M . 

From this, we obtain: 
Proposition 1. 

ai:={\iY'^= min max , / = 1,...,M. (3) 

V':codimy<i-l<M 0^xey,07^yey || x|| || Y || ^ 

The maximising x is Ui and the maximising y is Cui/\\Cui\\y, I = 1, . . . , M. 
Proof. Taking the square root of Q one has 

(A!c,x)y _ (£x,/:x)y _ ||£x||y _ (£x,y/||y||y)y 
1 /o — Ti Ti — ~T\ Ti — max - - , 

II^IU l|x|U o^yey ||x|U 

where the maximising y/Hylly is £x/||£x||3;. □ 

We will call the maximising unit x and y in ([3]) the left and right singular vectors of C, 
respectively. The o"; are the singular values of C. 



^Recall that an operator A on Hilbert space is called positive if (^x, x) > for all x. 
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3 Transfer Operators 



We now begin to be more specific about the objects in the previous section. We introduce 
measure spaces {X,Bx,fJ') and (Y,By,i^), where we imagine X as our domain at an initial 
time, with n being a reference measure describing the mass distribution of the object of 
interest. We now transform /i forward by some finite-time dynamics (involving advection 
and diffusion) to arrive at a probability measure u describing the distribution at this later 
time. The set Y is the support of this transformed measure u, and may be thought of as 
the "reachable set" for initial points in X. In applications, /i may describe the distribution 
of air or water particles, for instance, and u the distribution at a later time. 

We set X = L'^{X,fi) and y = L^(F, z/) and denote the standard inner product on 
L^{X,fi) by (■, and the inner product on L^(y, z/) by {■,-)u- We begin to place some 
assumptions on our transfer operator C : X ^ y and its dual. 

Assumption 1. 

1. {Cf){y) = f k{x,y)f{x) djj,{x), where k e L^{X x Y,Bx x ;By,/i x z/) is non-negative, 

2. Clx = ly, equivalently, f k{x,y) dfi{x) = 1 for u-a.a y, 

3. C*1y = Ix, equivalently, J k{x,y) du^y) = 1 for fi-a.a x. 

Non-negativity of the stochastic kernel k in Assumption[l](l) is a consistency requirement 
that says that if / represents some distribution of mass with respect to /i, then Cf also 
represents some mass distribution. Square integrability of k will provide compactness of C; 
we discuss this shortly. Assumption[l](2) says that the function 1 (the density function for the 
measure /i in L'^{X, /i)) is mapped to 1 (the density function for the measure z/ in L^(F, z/)). 
This is a normalisation condition on C Assumption [l] (3) says that C preserves integrals. 
That is, Jy Cf dv = / djj,. This follows since Jy Cf dv = {Cf, 1),^ = (/, C*l)^ = f djj,. 

Lemma i. Under Assumption\^(l), C : L\X,^i) L\Y,u) and C* : L\Y,u) ^ L\X,^i) 
are both compact operators. 

Proof. See appendix. □ 

Compactness ensures that the spectrum of C* C =: A : L'^{X,^) O away from the origin 
is discrete; in particular, the eigenvalue 1 is isolated and of finite multiplicity. Further, self- 
adjointness and positivity of A implies the spectrum is non- negative and real, so the only 
eigenvalue of magnitude 1 is the eigenvalue 1 itself. 

Assumption 2. The leading singular value 0"i of C is simple. 

We will show in Section 5 that the "small random pertubation of a deterministic process" 
kernel studied in Sections 4-6 satisfies Assumption |2} 

Proposition 2. Under Assumption^\ 

1. the largest singular value of C is ai = 1 and the corresponding left and right singular 
vectors are Ix and ly, and 
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2. Under Assumptionl^ 



^2= max I ■ if, 1)m = {9, 1). = !>< 1, (4) 



where the maximising f and g for are U2 (the second largest singular vector for C) and 
Cu2/\\Cu2\\, respectively. 



Proof. 



1. By Lemma [s] (see Appendix) using Assumption [T] (2) and (3), one has ||£|| = ||£*|| < 1. 
But Alx = Ix so lUll = 1. 



2. By compactness ai = 1 is isolated; non-negativity of the spectrum of A and simphcity 
of (Ji trivially implies a2 < 1. To show that Q = (T2, we note that by Assumption |2| 
when / = 2 Proposition [T] becomes 

aZ = mm max ., „ . (5) 

VcL^X,i,y.codunV<l fGV,gGL^Y,u) \\f\\f^\\g\\^ 



The minimising codimension 1 subspace V is spll}-*" (orthogonal to the leading singular 
vector 1). Thus (|5| becomes 



max 

feL^X,f,),geL^{Y,u] 



Arguing as in the proof of Proposition [T] the maximising (7/ 1| (7 above is £//||£/||y and 
as (£/, 1)1, = (/, 1)^ for any / G L^(X, /i) one may include the restriction {g, l)^, = 
without effect. 

□ 



3.1 Partitioning X and Y 

We wish to measurably partition X and F as Xi U X2 and Yi U Y2 respectively, where 
Goals 1. 

2. /i(Xfe) = z/(n),A; = l,2, 

The dynamical reasoning for these goals is that if Xi is a coherent set, then one should 
be able to find a set Yi C F that is approximately the image of Xi under the (advective and 
diffusive) dynamics. Similarly for X2, the complement of Xi in X. While Yi is possibly only 
an approximate image of Xi, we will insist that there is no loss of mass under the dynamics 
(the action of £). Thus /i(Xi) = viYi) and similarly for X2,Y2. We use the shorthand 
{Xi,X2} o X to mean that Xi and X2 are a measurable partition of X. 
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Consider the Set-based problem: 




{X,,X2}^X,{YuY2}<^Y \ \ V V /i(X2) i V z/(Fi) V iy{Y2) 



(< 



We first briefly justify the expression (S) in terms of our Goals. The constraints in ^ directly 
capture fi{Xk) = k = 1,2 from Goal[l|^2) above. Noting that iJi{Xk) = z^(lfc), k = 1,2, 

the objective may be rewritten as: 



X2 



= (j^^ + 1) + + 1) {C1x2Ay2)u - ri)^ - ri)^ 

_ lyi)i/ (£1x2; 1^2)1^ _ . 

Thus, the problem (S) is a natural way to achieve Goals [l](l) and (2) above. 

The set-based problem ^ is difficult to solve because the functions / and g are re- 
stricted to particular forms (differences of two characteristic functions). Using the shorthand 



i^XuX2 = y Jrl^Tylxi - V 5^)1^2 and iIjy,,Y2 = V " V SSj-'-^^, one can easily check 

that llfe.XalU = llV^n,y2lU = 1 and (V'xi.Xa, 1)^ = {i'Yi,Y2i 1);^ = 0- Thus, 

(S) < max {C-^Xi,X2,'^Y,,Y2)u 

{Xi,X2}^X,{YuY2}^Y 

< max I }?I'u^u ■ if, 1)m = {9, 1). = ol =■ (R), 

where we call (R) the Relaxed problem as it is a relaxation of the Set-based problem (S). 
Combining this with Proposition [2] we have 

Theorem 2. Under Assumptions^ and\^ 

/ (£lxi, lyi)i. , (£1x2, ly2)!^ \ /V ^ ; 1 ol ^ 1 1 

max < -— T— : ii(Xk) = uiYu), k = 1,2 >< 1 + (To. 8 

{Xi,X2}^x,{n,y2}^y \ M^i) M^2) ^ J- 



This result is related to the upper bound in Theorem 2 ^Ij. The main difference is 
that [21] is concerned with the dynamics of a reversible Markov operator at equilibrium 
and seeks fixed metastable sets, while here we have no assumption on reversibility of the 
dynamics, no restriction on the choice of (/x need not, for example, be invariant under the 
dynamics), and seek pairs of coherent sets Xk, Yk, k = 1,2, where the Xk are not fixed, but 
map approximately onto Y^ (which need not even intersect Xk)- 

Throughout this work, we have, for simplicity considered partitions of X and Y into two 
sets each. Our ideas can be extended to multiple partitions using multiple singular vector 



pairs, as has been done in the autonomous setting with eigenvectors of transfer operators 
to find multiple almost-invariant sets [151 ISSl [H]. As one progresses down the spectrum 
of sub-unit singular values, the corresponding singular vector pairs provide independent 
information on coherent separations of the phase space, which can in principle be combined 
using techniques drawn from the autonomous setting. 

Remark 1. In practice, solving (R) is straightforward once a suitable numerical approx- 
imation of L has been constructed. Following [22] we will take the optimal / and g from 
^ and use them heuristically to create partitions {Xi,X2} and {Yi,y2} via Xi = {/ > 
6},X2 = {/ < = {(7 > c},y2 = {^9 < c}, where 6 and c are chosen so that 

/i(Xfc) = u{Yk),k = 1,2. This can be achieved, for example, by a line search on the 
value of b, where for each choice of b, there is a corresponding choice of c that will match 
IJ.{Xk) = z/(Yfc), k = 1,2] we refer the reader to [T^l [22| for implementation details. 

4 Perron-Frobenius Operators on Smooth Manifolds 

We now consider the situation where the operator C arises from a Perron-Frobenius operator 
of a deterministic dynamical system. Our dynamical system T : M ^ M acts on a compact 
subselj^M C M''. The action of T might be derived from either a discrete time or continuous 
time dynamical system. In the latter case, T will be a time-t flow of some differential 
equation. There are no assumptions about stationarity, in fact, our machinery is specifically 
designed to handle nonautonomous, random, and non-stationary systems. We seek to analyse 
the one-step, finite-time action of T. 

Our domain of interest will be X C M. On X we have a reference probability measure fi 
describing the quantity we are interested in tracking the transport of. We assume that /i has 
an L'^{X,i) density /i^ with respect to Lebesgue measure i. We will discuss two situations: 
purely deterministic dynamics, and deterministic dynamics preceded and followed by a small 
random perturbation. In the former case we denote the set Y hj Yq = T{X) and the measure 
p by uq (with density h^o = duo/di), while in the latter case Y is denoted Y^ D T{X) and 
is denoted z/^ (with density h,^^ = du^/di); this terminology emphasises whether or not a 
perturbation is present. We define these objects formally in the coming subsections. The 
same subscript notation will also shortly be extended to C and A with the obvious meanings. 

Two notable aspects of our approach are (i) /x may be supported on a small subset X of 
M, enabling one to neglect the remainder of the phase space M for computations, and (ii) 
the possibility that X fl F = 0; thus X need not be close to invariant, but in fact, all points 
may leave X under the action of T. 

4.1 The deterministic setting 

Let i denote Lebesgue measure on M and suppose that T : X — )■ Iq is non-singular wrt 
Lebesgue measure (ie. i{A) = ^ £{T~^A) = 0) for all measurable A C Yq). The evo- 
lution of a density / G L^{X,i) under T is described by the Perron-Frobenius operator 

^One could generalise the constructions in the sequel to M a smooth Riemannian manifold in the obvious 
way. 
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V : L^{X,t) L^{Yo,t) defined by j\Vf di = J^.^^f di for all measurable A C Yq. If 

T is differentiable, one may write Vf{y) = XlieT-ij/ \det dt{x)\ ' however, in tlie remainder of 
this section we do not require differentiability of T. 

If we define Cq : L^{X,fi) — )• L^(YQ,h'Q) by Cof = V{f ■ h^)/h^Q, where h^^ = Vh^, then 
£* : L^iYo, z/q) L°^iX,n) is given by C*g = goT since, 

(^o/,^7).o = /^ir^-^^^o = y ^(/•M-^?^^ = / f-h,-goTdi = J f-goTdfi={f,Clg)^ 

using standard L^/L°° duality of "P (see eg. p48 [35j). 

We now briefly argue that it is not instructive to use C = Cq created directly from V. 
Firstly, if T is invertible (eg. arising as a time-t map of a flow), then a simple computation 
shows that = '^^o'^o is the identity operator and so there are no "second largest" eigen- 
values of only the eigenvalue 1. Secondly, without the invertibility assumption, one can 
informally (due to non-compactness of Cq) connect this dynamically with Theorem |2} We 
note that the LHS of (Isl) (substituting C = Cq) can be equivalently written as 



max |— ^^^-^ + . {X,,X,} ^ X, {Y„ Y,} ^ Y, 

= max ( ^l^^' l;-;^^)^ + (IX., iT-.y.). . ^^^^^^^ ^ ^y^^y^^ ^ 

By choosing {Yi, Y2} to be any nontrivial measurable partition and Xk = T^^{Yk), k = 1,2, 
the value of the above expression becomes 2, forcing (T2 = 1. Thus, we see that defining 
C = Co using the deterministic Perron-Frobenius operator V does not allow us to find 
a "distinguished" coherent partition; all partitions of this form are equally coherent. In 
practice, one is typically interested in coherent sets that are robust in the presence of noise 
of a certain amplitude, or in the presence of diffusion inherent in a dynamical or physical 
model. 



4.2 Small random perturbations 

To create "distinguished" coherent sets in purely advective dynamics, indicated by isolated 
singular values close to 1, we construct C = from the Perron-Frobenius operator and 
diffusion operators. We will apply diffusion before and after the application of the Perron- 
Frobenius operator. For X (Z X^ G M, we define a local diffusion operator 'Dx,e '■ {X, i) — )• 
L^{X^,i) via a bounded stochastic kernel: Vx^eQiy) = fx(^x,t{y — x)g{x) dx, where ax^e '■ 
M — )■ ]R+ satisfies otx,e{y — x) dy = 1 for x G X. Similarly, for Y^ G Y^ G M we 
define a local diffusion operator Vy^^e '■ L^(Xii^) ~^ L^(Xe,^) by Vyi^egiy) = fY,(yY,e{y — 
x)g{x) dx, where ay^^ is bounded and satisfies ay,e(?/ — x) dy = 1 ioi x E Y^. We have 
in mind that ax,e and ay^e are supported in an e-neighbourhood of the origin, and that 
X^ = supp(r'x,£lx)5 — ^(^e); Y^ = supp(r'x,ely/ ) • Thus, we have 

(X, i) (X„ £) ^L' (r;, ipHL\Y,, I) (9) 



9 



We now define V, : L^{X,t) L^iY.J) by VJiy) := VYj,eVVx,ef{y) and note that 

Vx,eVVYiJ{y) = I aY,e{y - x){VVx,J){x) dx 

Jyi 

= j aY^,{y - x)V (^j ax,e{x - z)f{z) dz^ dx 
= J CiY,e{y — Tx) i^j ax,eix — z) f (z) dz^ dx by duality of V 
(^Y,e{y — Tx)ax,e{x — z) dx \ f{z) dz 



X \JX, 



We note that to define via the final displayed expression above, T need only be measurable; 
in particular, T need not be nonsingular (nor invertible). 

Finally, we define an operator (which, under suitable conditions on ax,e and aY,e 
discussed shortly, will act on functions in L^(X, //)) by 

V (f -h ) Ixilx ^y^y - Tz)ax,e{.z - x) dz] f{x)h^{x) dx r 

CJ{y) = = = / K{x, y)f{x) dfiix) 

' Jx [ Ix, (^Y,e{y - Tz)ax,e{z - x) dzj h^{x) dx Jx 

(10) 

where K{x, y) = (^Jx (^Y,6{y — Tz)ax,t{z — x) dz^ / fx (^Jx ^Y,t{y — Tz)ax,e{z — x) dz^ dfi{x). 
We denote the normahsing term in the denominator (^J^ aY,e{y — Tz)ax,e{z — x) dz^ d^{x) = 

Veh^iy) as hy^{y), and define = dhyjdd. By Lemma [!} if k^{x,y) G L^(X x Y^, fi x u^) 
then £e : L'^i.X^ii) — L'^iY^, Ve) and is compact. 

We note that the dual operators : L°°(X„£) ^ L~(X,^) and P^^, ^ : L~(F„£) 
L^{Y^,i) are given by V\ J{x) = J^^axA^ - y)f{y) dy and V^,^^g{x) = Jy^aY,e{x - 
y)g{y) dy, respectively (in fact, since ax,t and aY,e are bounded, these dual operators may 
be considered to act on functions). It is straightforward to show that the dual operator 

: L2(Y;,z/,) L^{X,fi) is given by Clg{x) = Jy^k^{x,y)g{y) du^{y), and substituting 
Cix,e, CiY,e as abovc we have 



L aY,e{y - Tz)ax,e{z - x) dz) g{y) du^{y) 



aY,eiy - Tz)ax,eiz - x) dz\ g{y) dy (12) 
\Jx, J 

Cix,e{z - x) (^j aY,eiy -Tz) g{y) dy^ dz (13) 

= [ ax,e{z-x)lC{V*y,^^g){z) dz (14) 
Jx^ 

= V\^^olCoV*y,^^g{x) (15) 
where Kg = g oT is the Koopman operator. 
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X 



We now verify that satisfies Assumption [Tj For Assumption [T]^2), we set / = 1 
in (10) and for Assumption [T]^3), we set g = ly^ in (13). Whether is compact or not 
(Assumption [l](l)) depends on the form of ax,e and ay/, we show that is compact for a 
natural choice of ax,e,«y,e, namely ax,e = «y,e = lBE(o)/^(-Be(0))[^ This choice of ax,e,C(Y,e 
means that the action of is an averaging over a local e-ball, and the action of Ve may be 
interpreted as a small random perturbation with uniform density on an e-ball, followed by 
iteration by T, followed by another small random perturbation with uniform density on an 
e-ball. Explicitly, for this choice of one has 



fx {fx, 1b.(o)(i/ - Tz)1b,(o){z - x) dz^ f{x) dfi{x) 
Ix {ix, 1b.(o)(i/ - Tz)lB,(o)iz - x) dz^ dfx{x) 

Ix [Ix, '^B,{y){Tz)lB,{x){z) dz) f{x) dfi{x) 



Ix {ix, '^B,(y)iTz)lB,{x)iz) dz^ dfx{x) 
Ix (Ix, 'i-T-^B,(y){z)lB4x){z) dz) f (x) dfl{x) 



Ix {ix, '^T~'B,iy){z)lB,(x){z) dz^ dfl{x) 

since B,{x) C X,. (16) 



J^i{B,{x)nT-'B,{y))f{x) dfi{x 



e{B,{x) n T-^B,{y)) dfi{x) ' 

Thus, £e/ at ?/ G is a double-average over the pull-back by T of an e-neighbourhood 
of y. Clearly, Alx = 1^- Also, by (13): 

^*e9{x) = £(^^^(^Q^y 1b.(o)(z/ - Tz)1b,(o){z - x) dz g{y) dy 

'^B,{x){z) (77^77^ / '^B,{Tz){y)g{y) dy] dz 



mm Jx. "^^^^^ ' \mm 

noting that B^{Tz) C for z & and B^{x) C X^ for x G X. Using these facts, one may 
compute that C*ly^{x) = Ix- 

Lemma 2. If i{Y^) < 00 and ax,e{x) = aY,e{x) = lB4o){x)/i{B^{0)) then G L^(X x 
Y^, fi X z/f) and thus is compact. 

Proof. We show that k^{x, y) G L^(X x F^, /i x z/^); the result will then follow from Lemmajl} 
We use the fact that ay,£(y — Tz)ax,e{,z — x) dz = i{B^{x) fl T~^B^{y)) /i^B^)"^ as shown 



^In the case where M has boundaries so that B^{Tx) ^ M for some x € X, we assume that the kernel 
tte is suitably modified at these boundaries to remain stochastic. 
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in (16). 



K JX 



\ 2 

OiY,e{y — Tz)ax,e{z — x) dz j 
( Ix Ix '^y^y " Tz)ax,e{z — x) dz dfi{x)^ 

( Ix, '^y^y - Tz)ax,e{z - x) dz^ 
( Ix Ix ^yAv ~ Tz)ax,t{z — x) dz dfi{x) 



dfi{x)dh'^{y) 



dfi{x)dy 



iiT~^BMnB.ix)r ^^^^^^^ 



Jy. Jx Ix m'B^iy) n B,{x)) 
1 f i{T~^B,{y) n B,{x)y dii{x' 



x] 



dy 



^ 1 f J^iiT-'B,iy)nB,ix)) dfijx) ^ 
- "'"^M) JYJx^iT''B,{y)nB,{x)) df,{x) ^ 



By Lemma [l] we have that and C* are both compact. □ 

Corollary 1. If i{Y^) < oo and ax,e{x) = ay^e^x) = 1b4o){x) / i{B^{0)) , the operator 
satisfies Assumption^ 

In Section 5 we show that the above choice of ax,€, C(Y,e satisfies Assumption |2} 



4.3 Objectivity 

We demonstrate that our analytic framework for identifying finite-time coherent sets is objec- 
tive or frame-invariant, meaning that the method produces the same features when subjected 
to time-dependent "proper orthogonal + translational" transformations; see [TTl 128]. 

In continuous time, to test for objectivity, one makes a time-dependent coordinate change 
X I— )■ Q{t)x + b{t) where Q{t) is a proper othogonal linear transformation and b{t) is a 
translation vector, for t G [to, ti\. The discrete time analogue is to consider our initial domain 
X transformed to X = {Q{to)x + b{tQ) : x G X} and our final domain transformed to 
Ye = {Q(ti)y + b(ti) : y G Y^}. For shorthand, we use the notation and for these 
transformations, so that X^ = $to(X) and Y^ = ^tiiYe)- The deterministic transformation 
T : $t(,(M) — )■ $t^(M), which we wish to analyse using our transfer operator framework, is 
given by T = oTo<|>^^^. The change of frames is summarised in the commutative diagram 
below. 

M M 

We define fi = fi o and z/^ = z/^ o as the transformed versions of fi and u^; fi and 
are probability measures on X and Y, respectively. We further define the Perron-Frobenius 
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operators for and namely : L^{X,fi) — > L'^{X,fi) and P^^^ : z/^) — )• 

L2(F, z>,) by = / o and P<i,, J = / o respectively. 

The operators I^x^ and T>yi ^ are defined on X and analogously to the definitions 
of Vx,e and Vy^y, that is, Vj.^^g{y) = f^axAv ~ x)9{x) and Vyi^^giy) = jy', '^yAv - 
x)g{x) dx, where ax,e = ctjf.e = 1b,(o)/^(-S£(0)). Note in particular, that these operators 
are created independently of the operators T>x,e and T>Y^,e, and that -^y' e 

not simply defined by direct transformation of Vx^e and T>Y^,e with V^^^^V,^^^. While the 
transformed deterministic dynamics T must of course be defined by conjugation with 
our intention with the "small random perturbation" model is to use the same diffusion 
operators Vx,t, T^Yi,t, without any knowledge of coordinate changes, to construct an C^- 
Note that because and are proper othogonal affine transformations, one has 

o Vx,e = T)^ ^ o V^^^ and o Vy,^, = Vy,^, o V^,^ ; (18) 

geometrically, the LHSs are an averaging over e-balls followed by the transformations 
(resp. $ti), while the RHSs apply the transformation (resp. first and then average. 
The result is the same because $^^(-Be(x)) = -Be($t^^(a;)); similarly, for 

The Perron-Frobenius operator for T, denoted Vf is Vf = "P^t^ o V o V^^ . Denote 

hf. = V^,h^. Then, A : L\X,[x) -> L\Y,,u) is defined by CJ = Vy,^^ o VfO V^^^{f ■ 
hf.)/'Dy,^,oVfoVx^^{h^). 

Theorem 3. The operator in the original frame and the operator in the transformed 
frame satisfy the commutative diagram: 



*0 



Proof. Note that because is a composition operator, one has V^^^ if ■ g) = 'P'l'tgf ' '^•^t^d 
(and similarly for V^^^); we use this fact below. We also make use of (18). 

= v^,^ o n(p^^;/ ■ v^ih^)/v^,^ o n(p^^;^(/i^)) 

= v^,^ {v.{Vilf-h,)/v,{\ 



as required. □ 
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Corollary 2. If C^f = Xg where f and g are left and right singular vectors ofC^, respectively, 
then C/P<s,^^f = Wq>^_^g where V^^^f and V^^^g are left and right singular vectors of Ce, 
respectively. 

It follows from Corollary |2|that the coherent sets extracted on X and as eg. level sets 
from the singular vectors of will be transformed versions (under and $tj of those 
extracted from on X and Y^, as required for objectivity. 

More generally, if T>x.e and 2^y/,e are compact operators representing small diffusion, then 

o Vx,e = T^x,e° ^*io ^^"^ ^*ti ° '^yi,<^ ~ ^y',e ° ^*ti a sufficient condition for the 
method to be objective. 

5 The case of T a diffeomorphism 

In this section we specialise to the case where M = X = Y dW^ is compact, T : M ^ M 
is a diffeomorphism, and | det DT\ and are bounded uniformly above and below. 

5.1 Simplicity of the leading singular value of £g 

Our main result of this section states that the leading singular value of is simple when 
otx,e = 0!Y,e = Ifij (0) /^(-^e (0) ) ; thus Assumptiou [2] is satisfied. To set notation, note that 
one has C*g{x) = Jy k,{x,y)g{y) du,{y), so AJ{y) = K{x,y)f{x) d^{x), where K{x,y) = 
Jy ke{y, z)k{x, z) dvi^z). Let Alf{y) := fj^Kq{x,y) dfi{x). The following technical lemma 
provides sufficient conditions for simplicity of the leading singular value of C^. 

Lemma 3. // there exists an integer q > 0, a G E L^{X,fj,) such that Kq{x,y) < G{y), and 
a set A C X with fJ.{A) > such that i^q{x, y) > for all x E X and y E A, then the leading 
eigenvalue value of Ae, namely ai = 1, is simple. 

Proof. By Theorem 5.7.4 [33] under the hypotheses of the lemma, the Markov operator A 
is "asymptotically stable" in L^{X,fi), meaning that there exists a unique h E (scaled 
so that Jj^h dfi = 1) such that Ah = h and limfc_s.oo \\A.^f — h\\i = for all f E scaled 
so that Jj^ f dfi = 1. Since Alx = Ix by Assumptions (2)-(3), we must have h = Ix is 
the unique scaled fixed point in L^{X,^) and as L^(X, /ijc L^(X, /i), Ix is also the unique 
scaled fixed point of A in L'^{X,fi). As the eigenvalue 1 is isolated in L^(X, /i), it is simple. 
Simplicity of the leading singular value of C follows immediately. □ 

The ' 'covering" hypothesis in Lemma pi (^^(x, y) > for all X e X,y e A) can be 
interpreted dynamically as follows. Roughly speaking, the kernel k{x, y) is positive if it is 
possible to be transported from x G X to an intermediate point z eY^ under forward-time 
evolution, and then back to y E X under a dual backward-time evolution. Thus, Kg(x, > 
for all X G X and y E Ail after q forward-backward iterations, there is a positive //-measure 
set A d X reachable from all x E X. One way to satisfy this is for the kernel to include 
some diffusion so that the reachable regions strictly expand with each iteration of A^- This 
is exactly what happens in a controlled way when we use ax,e = «y,e = 15^(0) /^(-^^(O)). 
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Proposition 3. If M = X = Y G M.'^ is compact, T : M ^ M is a diffeomorphism, 
I det DT\ and are bounded uniformly above and below, and ax,e = «y,e = ^b^{o)/^{B^{0)), 
the leading singular value of is simple. 

Proof. By Lemma [o] (see Appendix), one has that is bounded. Note that 

K{x,y) = j k{y,z)k{x,z) dv{z) <\\k\\^ j k{y,z) (iz/(z) = ||/i;||oo. 

Further, 

Kq{x,y) = / / ■■■/ k{x,Xi) ■ ■ ■ K{Xq-2,Xq-i)K{Xq-i,y) dfliXi) ■ ■ ■ dlj{Xq-i) 

J X Jx Jx 



q—1 times 

< 




X Jx 



/ ll^ll^o ^ d^{xi) ■ ■ ■ dix{xq-i) = \\k\\l^ \ 
Jx 



Thus, in the hypotheses of Lemma |3] we may take G{y) = || ^ G L^{X, jj). By Lemma 10 
(see Appendix) the covering hypothesis of Lemma [s] is satisfied; the resuh follows by Lemma 
|3l □ 



5.2 Regularity of singular vectors of 

A standard heuristic for obtaining partitions from functions is to threshold on level sets; 
such an approach has been used in many previous applications of transfer operator methods 
to determine almost-invariant and metastable sets for autonomous or time-independent dy- 
namical systems [151 [Tl]. By employing this heuristic, forming eg. Xi = {x & M : f{x) < c} 
where / is a sub-dominant singular vector of C^, and c G M is some threshold, if / has some 
regularity, this places some limitations on the geometrical form of Xi. 

We derive explicit expressions for the Lipschitz and Holder constants for the eigenfunc- 
tions of C*Ce and showing how these constants vary as a function of the perturbation 

parameter e. We begin with two lemmas that demonstrate the regularity of Vx,ef, for 
/ G L^(X, /i). Completely analogous results hold for the regularity of Vy^^ed, 9 € L'^iXe^ K)- 
In order to obtain a Lipschitz bound on 'Dx,ef, one requires / to be bounded; on the other 
hand, the Holder bound is in terms of the L^-norm of /, which is better suited to our setup. 
In one direction (right singular vectors of £e) we can combine the Holder bound and the 
Lipschitz bound to provide a better estimate than a direct Holder bound. 

We remark that our diffusion kernels ax,e, C(Y,e need not be Lipschitz nor Holder. Some 
prior work has considered the regularity of the range of V followed by a smoothing operator, 
denoted by P^, in either a C° or setting: this includes Zeeman, Lemma 5 [51j, who dis- 
cusses the equicontinuity of the image of the unit sphere in C° and a^{x) = nexp(— ||x|p)/2e 
is smooth, and Junge, Prop. 3.1 [32j, who bounds the Lipschitz constant of V^Vf in terms 
of the L^-norm of / using a Lipschitz kernel (the bound is La\\f\\L^{£)/e^^'^, where La 
is the Lipschitz constant of a fixed kernel a that generates the family a^). The finite-time 
aspect of our approach (as opposed to the effectively "asymptotic" aspect of fixed points of 
V^V in [SD 132]) necessitates the use of the operator V^W^ in order for the singular vectors 
at both the initial and final times to contain meaningful dynamical information. 
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As most of the proofs of the following results are technical, we have deferred them to the 
Appendix. 

Lemma 4. Let f e L°°(X,£), where X C R'^ zs compact, 1 < d<3. Let a, = 1b J 1(8,). 
Then T>x,tf is globally Lipschitz on with Lipschitz constant bounded above by Ci^d) ||/||L°o/e, 
where Ci^d) = l,4/7r,3/2, for dimensions 1,2,3, respectively. 

Lemma 5. Let f G L'^{X,£), where X C M^, 1 < < 3. Let a, = 1bJ£{B,). Then VxJ 
is globally Holder on X^: 



iVxJXx) - Vx,J{y)\ < \\f\\LHi)^^\\x - for all x,y e X„ (19) 



where C{d) = l/-\/2, A/2/7r, 3/(2-\/27r), for dimensions 1,2,3, respectively. 
Proposition 4. 

1. If f & L^(X, yu) with J f dfi = 0, then C^f is Holder and 

\CJix) - CJiy)\ < \\f\\LH,)Cid) ■ C'h ■ (l/e^+i)||x - y\\'/\ for all x, y G F„ 

in dimensions d = 1,2,3, where < < oo is a constant depending on properties of 
T and h^. 

2. If f is bounded with j f dfi = 0, then C^f is Lipschitz and 

\CJix) - CJiy)\ < WfWooCLid) ■ C'l ■ il/e')\\x - yl for all x,y e 

in dimensions d = 1,2, 3, where < < oo is a constant depending on properties of 
T , h^, and M. 

The explicit form of and are given in the proofs in the appendix. 
Proposition 5. If g E L'^{Y,v^) then C*g is Holder and 

\£.*g{x) -C*g{y)\ < ||^||i2(^^)^-^^^||x - for all x, ye X„ 



in dimensions d = 1,2, 3, where A = min^-gx^ I det DT{x)\. 

As the random perturbations or noise of amplitude e is increased. Propositions |4] and 
[s] show that the images of functions under and C* become more regular in a Holder 
(or Lipschitz) sense. This information can be used to imply similar regularity results for 
the left and right singular vectors of C^. As we anticipate that the optimal iPxi,X2j4'Yi,Y2 
the set-based problem (S) (section 3.1) will have coefficients of 0(1), we are interested in 
the minimum spatial distance in phase space that can be traversed by an 0(1) difference in 
value of the singular vectors of C^. Lower bounds on the e-scaling of these distances are the 
content of the following corollary. 

Corollary 3. 
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1. Let f G L'^ifJ') be a suhdominant left singular vector of (an eigenfunction of C*Ce 
corresponding to an eigenvalue less than 1), normalised so that ||/||l2(^) = 1. An "0(1) 
feature" has width of at least order e'^^^ . 

2. Let g G L'^{v^) he a suhdominant right singular vector of (an eigenfunction of C^C* 
corresponding to an eigenvalue less than 1), normalised so that \\g\\L'^{v^) = 1. An 
"0(1) feature" has width of at least order e*^^+'^^/^. 

Proof. 

1. A subdominant normalised singular vector / G L'^{X,fi) arises as an eigenvector of 

and in particular / = C^g for some g G L'^(Y, z/J with J g dv^ = and ||5'||l2(j,^-) = 
1. By Proposition [5] we see that the Holder constant of / = C*g is 0(l/e*^^+^)/^). Thus, 
if along a given direction, g increases from zero to 0(1) and decreases to zero again, the 
minimal distance required is 0((e*^'^"''^^/^)^) = 0{e'^~^^). In detail, if 1 < Hi/2{f)-\x—y\^^'^ 
then 

|x-y|>l/iJv2(/)' = ^/0(rf)V+\ 

2. A subdominant normalised singular vector g G L'^{Y^,i'^) arises as an eigenvector of 
C^C*. We begin with a g & L'^iye) and apply Proposition [s] to obtain ||£*(7||oo < 
^(i+d)/2 ■ diam(M)^/^ using the fact that J g du = 0. We now apply Proposition jij 
(2) to obtain 

UB diam(M)i/2C'(rf)Oi(rf) U^B^ diam(M)3/2C(c/)Oi(c/)2 

Now, in order to have an 0(1) feature we require 1 < L{f) ■\x — y\ or |x — y| > 1/L(/). 
Since we have an upper bound for L(/), the width of an 0(1) feature must be at least 

□ 



Remark 2. Note that if we use only Proposition |4] (1) in the proof of Corollary [3] (2), we 
would obtain 0{e^'^^'^), which is worse than the estimate in the Corollary. 

5.3 Scaling of cr2,e with e 

We now demonstrate a lower bound on cr2,e, for small e, where (T2,e is the second singular 
value of £e- A bound similar is spirit to Corollary |4] was developed in the autonomous two- 
dimensional area-preserving setting |33j. Related numerical studies of advection-diffusion 
PDEs include ES]- We begin by choosing some e* > and a fixed partition 2 
of Fe*- The partition {Yk,e*}k=i,2 induces compatible partitions for y^, < e < e*, namely, 
{Yk,t}k=i,2, where Yk^e := Yk^e* H the restriction of Y^.e* to Y^. In what follows, it will be 
useful to consider the "e-interior" of a set A, denoted A := {x E A : B^{x) C A}. 

Lemma 6. Let T : X Yq he non-singular and suppose that ^ is supported on X and 
absolutely continuous. One has 

MT-n,) + MT-r^,) - JliJQ + M^2) - ' + 



17 



for alio < e < e*. 

Proof. First note that by Theorem [2| one has 

for any partitfon {Xi,X2} of X and {Yi,e,F2,e} of Y^. To partition X we choose 
T~^Yk^t n X; one may check that in fact Xk '■= Xkfl = X^^t for all < e < e* and 
{Xk}k=i^2 partitions X. 

In what follows, we will use the following two inequalities: For W C Y^, 

V*y,^^lw{x) = {1/^{BM) I lB.i.){y)lw{y) dy 

t{Y,nB,{x)nw) 



and for V C X^, 



^{x,r\B,{x)r]V) 



mix)) 

> Ivix). 

Now, for k = 1 (and identically for k = 2) and < e < e* we have 

> (lT-iyi,,,^^x,e^lyi,,)/^ 

= {lT-iY,,,V*x^^l^^^yJ^ noting T-ifi,, C X, 
Since fi{Xi) < /i(T^^Yi^e) we have 



and similarly for X2, 1^2 ^, and the result follows. 
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Lemma 7. Using the notation of Lemma suppose that Yq is a smooth manifold with 
smooth boundary, is smooth, and fi is absolutely continuous with density bounded above 
and below. Given some e* > one may choose Yi^^*,Y2^e* so that there exists < C < oo 
with 

2_^,<MT^^MT^ (22) 

for all < e < e* . 

Proof. In order to achieve a tight lower bound for a2,e, we should choose Yi^^* , F2,£* judiciously. 
Under the hypotheses, Y^* has smooth boundary. Choose a partition {lfc,e*}fc=i,2 of two 
simply connected sets with non-empty interior so that each element has smooth boundary, 
and so that ^{T~^Yk^e*) = 1/2. Now for all < e < e*, for small enough e, for each k = 1,2, 

one has fi{T~^Yk,e) / fJ'iT'^Yk^e) > 1 — Ce, where the constant C depends on /i, T, and the 
curvature of the boundaries of the Yk^e* ■ □ 

Remark 3. Note that in order to optimise (minimise) the constant in the C above, one 
chooses yfc,e*, = 1,2 so that the co-dimension 1 volume of the shared boundary of Yi^^* 
and y2,e* is small and the co-dimension 1 volume of the shared boundary of T~^Yi and 
T~^Y2^e* is small. We see here the core of the reason for the "double" diffusion (pre- and post- 
T-dynamics) in the definition of If we defined as Vyi^eT^ (resp. Wx,e), then we would 
choose Yk^e* with small shared boundary (resp. choose T^^Yk^e* with small shared boundary), 
and not care about the boundaries of T~^Yfc,e* (resp. Yk^e*)- By defining = VYi,eWx,e 
we require small shared boundaries for both initial and final time partitions, and guide the 
2nd singular vectors (and the subsequently constructed coherent sets) toward having smooth 
boundaries at initial and final times. 

Corollary 4. In the setting of Lemma and under the hypotheses of Lemma one has 
l-a2,e<Ce forQ<t<e*. 



6 Numerical Example 

We now numerically investigate the constructions of the previous sections. Our numerical 
example is a quasi-periodically forced flow system representing an idealized stratospheric 
flow in the northern or southern hemisphere (see [H]), defined by 

dx _ 

dt dy 
dy _ d"^ 
dt dx 

with streamfunction 

'^{x,y,t) = csy — UoLtaBh{y/ L) + A3UoLsech.^{y /L) cos{kix) 

+ A2UoLsech.'^ {y / L) cos(/i:2X — S2t) + AiUoLsech'^ {y / L) cos(fcia; — Sit). 
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We use the parameter values as in [21], i.e. Uq = 5.41, Ai = 0.075, A2 = 0.4, A3 = 0.2, 
L = 1.770, C2/U0 = 0.205,C3/?7o = 0.7, h = 2/re, fca = 4/re, h = 6/re where Ve = 6.371 
as well as S2 = k2{c2 — C3), Si = 52(1 + a/5)/2, where we have dropped the physical units 
for brevity. We seek coherent sets for the finite-time duration from t = 10 to t = 20. As 
the flow is area-preserving, we set /i^ to be constant. Rypina et al. [H] show that there 
is a time-varying jet core oscillating in a band around y = 0. The parameters studied in 
j41j were chosen so that the jet core formed a complete transport barrier between the two 
Rossby wave regimes above and below it. In [22j some of the parameters were modified to 
remove the jet core band, allowing a small amount of transport between the two Rossby 
wave regimes. Thus we expect that there are two coherent sets; one above the removed jet 
core, and one below it. We demonstrate that we can numerically find these coherent sets, 
and illustrate the effect of diffusion. 

In order to carry out a numerical investigation we require a finite-rank approximation of 
To construct such an approximation, we use the numerical method of [22], whereby the 
domains X and are partitioned into boxes and an estimate of V^-, and then is obtained. 
We carry out two experiments at differing e values. 

6.1 Pure advection with implicit numerical diffusion 

Firstly, we directly use the technique from [22|- We partition [0,20] x [—2.5,2.5] into 2^^ 
boxes, leading to boxes of radius 0.0391 x 0.0195. We obtain finite rank estimates of V and £9, 
which are 32768 x 39465 sparse non-negative matrices P and L, respectively; these matrices 
was produced using 400 test points per box (see [22] for details). The leading singular value 
of L is 1, and the second singular value is cr2 = 0.9969. The discretisation procedure used 
to estimate Cq leads to a "numerical diffusion" so that one effectively estimates with 
e ^ 0.0391; this is the reason for the spectral gap appearing in the numerical estimate of 
Cq. An estimate of h^^, produced as IP, is shown in Figure 1 (left). The second left (resp. 
right) singular vector is shown in the left image of Figure 2 (resp. Figure 3). Note that the 
value of the singular vectors in Figures 2 and 3 is predominantly in the vicinity of ±1, and 
that there is a clear separation into two coherent sets, consistent with the known facts about 
transport in this system. An optimal level set thresholding of the second left (resp. right) 
singular vector is shown in the left image of Figure 4 (resp. Figure 5); see Remark [l] for 
details. The maximal value in ([t]) obtained from this level set thresholding procedure was 
computed to be 1.9854, consistent with (and close to) the upper bound of 1.9969 given by 
(|8|. The /i-measures of the red (resp. blue) sets are approximately 0.5064 (resp. 0.4936). 

6.2 Advection with explicit diffusion 

Secondly, we explicitly apply a diffusion of radius e = 0.1 before and after the action of 
V^. Numerically, this is achieved by applying a mask of 37 points in an e-ball about each 
of the 36 test points per box, before and after the action of the deterministic dynamics. 
This results in a 20480 x 29071 matrices and with the latter having a leading singular 
value of 1 and second singular value a2 = 0.9793. An estimate of hu^, produced as IP^, is 
shown in Figure 1 (left). The second left (resp. right) singular vector is shown in the right 
image of Figure 2 (resp. Figure 3). An optimal level set thresholding of the second left (resp. 
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Figure 1: Left: Density of pushforward of Lebesgue measure on [0,20] x [—2.5,2.5] by a 
discrete form of "P^, e ~ 0.0391 (a discrete approximation of h^J- Right: As for Left, with 
e = 0.1. 
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Figure 2: Left: Discrete approximation of the second left singular vector of C^, e ~ 0.0391. 
Right: As for Left, with e = 0.1. 
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Figure 3: Left: Discrete approximation of the second right singular vector of £e, e ~ 0.0391. 
Right: As for Left, with e = 0.1. 
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Figure 4: Left: Thresholding second left singular vector of £e, e ~ 0.0391 to maximise 
expression ([T]). Right: As for Left, with e = 0.1 
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Figure 5: Left: Thresholding second right singular vector of C^, e 
expression ([T]). Right: As for Left, with e = 0.1 



0.0391 to maximise 
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right) singular vector is shown in the right image of Figure 4 (resp. Figure 5); see Remark 
[ijfor details. The maximal value in ([T]) obtained from this level set thresholding procedure 
was computed to be 1.9544, consistent with the upper bound of 1.9793 given by The 
/x-measures of the red (resp. blue) sets are approximately 0.5031 (resp. 0.4969). 

Furthermore, the increasing regularity of the left and right singular vectors with increas- 
ing e, as predicted by Propositions |4] and |5] is evident in Figures 2 and 3. 

A Proofs 

A.l Boundedness and compactness of jC^ and 

The following Lemma is a straight-forward modification of Prop 11.1.6 in Conway [7j, which 
we include for completeness. 

Lemma 8. Let {X, fi) and {Y, v) he measure spaces and suppose A; : Xxy — )■ M zs measurable, 
and that 



If K : L^(X, yu) — > L^(F, z/) is defined by Kf{x) = k{x, y)f{y) dfi{y) then K is a bounded 
linear operator and \\K\\ < (ciC2)^^^. 

Proof. 





for v-almost all y ^Y 



(23) 



(24) 




X / \JX 

/ r \ 1/2 



1/2 




Thus, 




□ 
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Proof of Lemma\l\ We follow the proofs of Proposition II. 4. 7 and Lemma II. 4. 8 gen- 
eralising from L^(X x X, /x x /i) to L^(X x Y, ^ x u). Inner products and norms on 
L^(X, yu) and i/) will have subscripts /i and z/ respectively; no subscript means an 

inner product or norm on (X x Y, fi x u) . The assumptions on the integrability of k guar- 
antee that C : L'^{X,fi) — L^{Y,u) and its dual are bounded linear operators: H-C/H^ = 
JiJk{x,y)fix) dfiix)f duiy) < Jijkix.yf dfiix) ■ J fix)' dfiix)) duiy) = 
similarly for C*. 

Let {cj} be an orthonormal basis of Iv^(X, fi) and {fj} be an orthonormal basis of L''{Y, u). 
Define (j)ij{x,y) = ei{x)fj{y). It is easy to check that {4>ij} is an orthonormal set in L^(X x 
y, yU X z/) : 



eiix)fj{y) ■ek{x)fi{y) d^i{x)dv{y) 

ei{x)ek{x) dfi{x) ) fj{y)fi{y) du{y) 



One also has 

{k,(f)ij) = k{x,y)(l)ij{x,y) dfi{x)du{y) 



k{x,y)ei{x)fj{y) dn{x)diy{y) 

Therefore \\kf > Y.i,j = Eij f j) ■ Since k e ^^(X xY,^xv) there are at 

most a countable number of i, j such that (/c, 0^) 7^ 0; denote these by {ilJim} and note that 
= unless e {V'zm}- Let ipim{x,y) = ei{x)fm{y), let P„ : ^^(X,/!) I^^(X,/i) 
be the orthogonal projection onto {e^ : 1 < / < ri} and Qn : L'^iX,^) L'O^,^) be the 
orthogonal projection onto {/„ : 1 < m < n}. Define £„ = CPn + Qn^^ — Qn'C.Pn, a 
finite-rank operator. We will show that ||£ — — )■ as n — )■ 00, showing C is compact. 



27 



Let g e L'^{X,ij,) with < 1, and write g = 'Ylii'^i^i- One has 
\\^9-^ng\\l = ^\{Cg- Cng,fj)v\^ 



= E 

3 

= E 



i 



m I 

m I 

= \\9\\l^^\{^ei,fm)uf 

m>n l>n 
m>n l>n 

The penultimate equahty holds since when I < n, PnCi = e; and when m < n, Qnfm = fm] 
thus if either I < n or m < n, the entire expression is zero. Finally, since ^ |(A;, (f)im)\'^ < 
1 1 A; 1 1 < oo, given e > 0, choose n large enough so that this sum is less than e^. Since £ is 
compact, so is £*. □ 

A. 2 Simplicity of the leading singular value of Ce 

For the two lemmas in this section we assume that X = Y,: = M G is compact, that T 
is a diffeomorphism, that /i is absolutely continuous with positive density, and that ax,e — 



Lemma 9. k^{x,y) is bounded. 



Proof. Recall 



k,{x,y) = 



£(B,(x)nT-^B,{y)) 



J^e{B,{x)nT-^B,{y))df,{xy 

Clearly the numerator is uniformly bounded above by i{B^{0)); we now show that the de- 
nominator is uniformly bounded below. One has £{T^^Bc) > i{B^{0))/ sup^gjy^ | detDT(a;)|. 
Define 5* = sup{5 : for all y E M,3z = z{y) such that Bs{z) C T-^B^{y)}. Since | detDT| 
is uniformly bounded above, 5* > 0. Then / i{B,{x) n T-^B,{y)) dn{x) > D* ■ i{Bs*/2{0)) 
for all y e M, where D* = iniy^u l^{{z e T-^B,{y) : B5,/2{z) C T-^B^{y)}. Since is 
absolutely continuous with positive density, > 0. □ 
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Lemma 10. There exists a q > and an A G X with fi{A) > such that K,q{x,y) > for 
fi-a.a. X & X and y E A. 



Proof. Consider the action of = C*Ce on a distribution 6x- As Ce{f) = ^^y/,e o P o 
T^x,e[,f) /T^Yi,e o V o Vx,e{f ' hfj,), the initial apphcation of 'Dx,e produces a function with 
support -Be(x) (in fact, The apphcation of V now creates a function with support 

T{B^{x)) (because | det DT\ is uniformly bounded above) and finally the application of I^y/,e 
produces a support of B^{T{B^{x))). Now applying C* we again apply I^x,e, then T~^, 
then T>Yi,e, producing a function with support S = B^{T~^{B^{B^{T[B^{x)))))). Clearly 
B^l2{x) C S. At each iteration of Ae the support expands by at least e/2. As X is bounded, 
eventually the support fills X after q iterations for some q. Thus Kq{x,y) > for fi-a.a. 
X e X and y e X. □ 

A. 3 Regularity of singular vectors of £g 

Proof of Lemma j^} One has 

\1^X,efiy + 7) - '^X,ef{y)\ + ax,e{y " x)) f {x) dx\ 



fx \^x,e{y + - ax,eiy ^ x)\ dx 



< 



Jx |lB.fa+7) ~ '^B,{y)\ dx 

iy))h\\ 



We show that limsup|,^|,^o l^^x, J(y + 7) - ^^x, J(y)| /hll < C'||/||Loo/e, for all x e X. 
From this, global Lipschitzness follows by Lemma 16 We now detail the computations for 
dimensions 1, 2, and 3. The main estimate is for i{B^{y + '~f)AB^{y)) in (25), which only 
depends on e and 7. 

Dimension 1: B^ is an interval of length 2e and clearly i{B^{y + 'y)AB^{y)) = 2\'y\ for 



< |7| < 2e. Thus for < I7I < 2e, ^ = ||/|Uo.2|7|/(2e|7|) = Wfh^/e. 

Dimension 2: B^ is a disk of radius e. For < ||7|| < 2e, the symmetric difference area 

miy + l)^B,{y)) is A = 2(7r62-(262cos-i(ll7ll/2e)-(l/2)||7||v/4^^^HP)) [48j. To 
first order in ||7||, cos-i(||7||/2e) = 7r/2 - ||7||/2e + 0(||7|n. Thus A = 2(7re2 - yre^ + ||7||e + 
(l/2)||7||v/4e2-||7||2) + OHM') and limsup||,||^o A/hlke^ = ||/|Uo.(4/7r)/e. 

Dimension 3:B^ is a disk of radius e. For < ||7|| < 2e, the symmetric difference volume 
E{B,{y + -i)/\B,{y)) isV = 2(4/37re3- (7r/12(4e+ ||7||)(2e- hll)^)) [IS]. To first order in ||7||, 
V = 2(4/3vre3 - (7r/12(16e3 - 12el7ll))) + 0(||7f )• Thus lim||,||_o \\fh^V/\MiA/3)ne' = 
U^27re2||7||/||7ll(4/3)7re3=||/lUoc(3/2)/e. 



By Lemma [16] the constants found above are also global Lipschitz constants. □ 
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Proof of Lemma\5\ Let x = ?/ + 7. One has 



\Vx,J{y + i)-Vx,J{y)\ 



{ax,e{y + - ax,e{y - x))f{x) dx 



X 



< ■ ( / iax,eiy + 7 - x) - ax,eiy - x)) dx 

1/2 



X 



1/2 



< \\fh^,yim{y + i)ABM)f'/miy)) (26) 

We now detail the computations for dimensions 1, 2, and 3. The main estimate is for 
i{B^{y + 7)Ai?e(i/)) in (26), which only depends on e and 7. 
Dimension 1: is an interval of length 2e and clearly 



i{B,{y + ^)/\B,{y)) 



2||7ll, Il7ll<2e; 
2e, II7II >2e. ' 



Thus 



m,{y + ^)/\B,{y))f" lt{BM) 



711 



2e ' 
\/2e 
2e ' 



> e. 



and one has \VxJ{x) - VxJ{y)\ < WfhHe) ■ ^/l]\\x - yf/'. 

Dimension 2: B^ is a disk of radius e. For < ||7|| < 2e, the symmetric difference area 
miy + 7)^B,{y)) isA = 2{7re' - (26^ cos-i(||7||/26) - (1/2)||7|| ^4^' - hP)) |48j. Thus, 



iiB,iy+^)AB,iy)) 



2(7re2 - (2e2cos-i(||7||/2e) - (l/2)||7||v^ 



0), 



< 2e; 
> 2e. 



{i{B,{y + ^)ABM)f'/£{BM) 

^2{ne^ - (2e2cos-H||7ll/26) - (1/2)||7|| ^46^ - W))/{rre'), h\\ < 2e; 
v^/(7re2), II7II > 2e. 

and one has 

\Vx,Jix)-Vx,Jiy)\ < Wfhm) ■ VV^^\\x-y\\'/' 

for all x,y & X. 

Dimension 3:B^ is a disk of radius e. For < ||7|| < 2e, the symmetric difference volume 
£(i?,(2/ + 7)A5,(y)) isig 



V = 2(4/37r63-(7r/12(46+||7||)(26-||7|in) 

= SvreVS - ((7r/6)(4e + ||7||)(46^ - 4||7||e + hf)) 

= 87reV3-((7r/6)(16e^-12||7||e^ + ||7f)) 

= 27r||7||62-7r||7||V6. 
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Thus 
Thus 

{iiB,iy + ^)AB,iy))f'/miy)) = 



v/(27r||7||e2-7r||7||V6) ■ S/{A7re^), < 2e; 
vW2^^, Il7ll>2e. 



v/TAV9||7||/8-3||7||V32e2^, ||7|| < 2e; 
^ x/372^#, hll > 2e. ' 

and one has 

\Vx,Jix) - Vx,Jiy)\ < WfWme) ■ (3/2) v^^lk - y\\'/' 
for all x,y E X. □ 



Setting notation for the following lemmas, T : M — )■ M is a diffeomorphism with < 
A < I det DT\ < B < oo and < L < < U < oo. Moreover X = Y = Y^ = M. 

Lemma 11. ||/ ■ h^LHe) < U'^'WfWmf.)- 
Proof. 

□ 

Lemma 12. If f E L^{^) satisfies c < f < d then c < Vx,ef < d 

Proof. This follows since T>x,e is an averaging operator. □ 
Lemma 13. \\Vx,ef\\L^{i) < ||/||l2(£)- 

Proof. This follows directly from Lemma [sj putting k(x,y) = lB,(y){x) /i{B^(0)) one has 



k{x, y) dx = 1 for all y E X^ and f-^ k{x, y) dy < 1 for all x G X. □ 
Lemma 14. ||P/|U2(,) < l/A^^fU^^.y 
Proof. 

foT-^ \2 



{VfY 



det DToT-^ 

2 



f 



det DTI/ IdetDT-ioTl 



by change of variables under T 



det DT\ 
< l/A [ f dt 



□ 
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Proof of Proposition 

1. Let Hi/2{f) denote the 1/2-Holder exponent for /. Since £e/ = T^Yi,e'PT^x,e{.f 
hf,)/VYj,e'PVx,eh^ we have 



Hy2iCJ) < H,/2i'Dy,,,PVxAf ■ K)) 



1 



+H1/2 



1 



VY:,eVVxAf ■ K))\oo- 



By Lemmas [11} [T3| and 14 we have 

WVVxM ■ h,)\\LHe) < \\V\\LHe)\\VxAf " h^)\\LHe) < (U/AY^'I 
and so applying Lemma |5] we have 

H^/2iVy,,VVxAf-h,)) < iU/Ay/^f\\,.^,)C{d)/e('^'y' 
where C{d) is from Lemma IS] Moreover, since h^^ = T>x,eh^ is bounded below and 



above by L and ?7, respectively (by Lemma 12) we have h^i^ = Vh^^ is bounded below 



and above by L/B and U/A respectively. Finally, applying Lemma 12 again, we have 

A/U<\l/VY>,eVVx,eh,\<B/L. 

For the second term, note 



Hl/2 



1 



< 



< 



< 



Hl/2{'DYl,ehu'^) 

\\hu'S\L^{i) C{d) 



(mm h„i ' 



c{d+l)/2 



by Lemma and Lemma 12 



(max /i^/) 1/2 C{d) 



(min/i^,)2 t^d+i)/2 

vl/2 



as ||li(^) = 1 we have ||l2(^) < (max/i 



jU/A) iJd+i)/2 

Finally, to bound |'Py_,',ePI^x,e(/ ■ h^))\oo we note that since J f dfi = we have 
/ 1^Yj,e'P1^x,e{f ■ h^) di = since VY^,e,1^x,e, and V preserve ^-integrals. Thus, 
\Vy,[eVVxAf ■ K))\oo < Hy2iVY>,,PVxAf " diam(M)|V2. 
Putting this all together we have 



Hy2{CJ) < (f/M)i/2£(X,)||a|U ■ (i?/L)||/|U.(,)C(rf)/6('^+i)/2 

{u/Ay/^ 



{L/Bf 



C{d)/e 



(d+l)/2 _ 



(U/A) 



1/2 



L2(m) 



Cid)/e 



(d+l)/2| 



diam(M)| 



1/2 



2. Let L{f ) denote the Lipschitz exponent for /. Since C^f = 'DYj,e'PVx,t{f-hfj)/'DY^,t'PVx,ehfi 
we have 



L{CJ) < L{Vyi,,VVxM-K))- 



VYl,eVVx,eK 
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+L 



VYl,eVVx,eW 



■\VY^,eVVxM-hM 



We have that \VVx,e{f-h^)\ < (f//A) ||/||oo and applying Lemma|4|we have /.(Py^/^.PPx.el/- 
h^)) < {U / A)\\f\\ooCL{d) /e where Ciid) is from Lemma[4j Similarly, we have A/U < 
\llVy,^,VVxM<B/L. 

For the second term, note 

1 ^^ ^ l{Vyi^,K,) 



< ; — \- ■ by Lemma |4| and Lemma [12 

(min/ij^/)^ e 

Finally, to bound \VY^,e'PVx,e{f ■ ^^t))|oo we note that since J f = we have 
J VY'^/PVx,t{f ■ h^) di = since Vx,e,1^Y',e, and V preserve ^-integrals. Thus, 
l-DY^^eWxM ■ h^.))\oo < LiVYj,,VVxAf ■ h^))\dmm{M)\. 
Putting this all together we have 

L{CJ) < (t/M)(i?/L)||/|UC',(rf)/6 + |^^||/|U|diam(M)|C^(rf)V62 

□ 

Lemma 15. Consider K, : — L'^{X^,i). One has \\ICg\\L2(_x„e) < ||5'||L2(y/,£)/v^- 

Proof. 

1/2 



WlCghw) = / {9{Tx)y dx 



1/2 

(^(x))V|detDT(T-^x)| dx 



□ 



Proof of Proposition\^ Note that £* = V^^ICVy,^^. We first claim the L^-norm of K^Vy,^^ 
is 1/\/A. By Lemmap, putting X = Y^, Y = Y^, and k{x,y) = iB^(y)ix) /£{B^{y)), we have 
that \\VYj,e9\\LHY„i) <lfi'||L2(y/,£)- This follows since Jy, lB4y){x)/i{B,{y)) dx < 1 for y e 
and Jy lB,(x)(z/)/^(-Be(a;)) rfy = 1 for x G F/. By Lemma ISlthe claim follows. 



We now consider \V^^f{x) — V'^^f^y)] for / G L'^{X^,i). Because of the symmetry of 
the kernel k{x,y) = lBc(y){x)/i{B^{y)), the only difference between D^.e and P^Ce the 
domain of integration (respectively X and X^). The bound of Lemma [s] thus also applies to 
V*x ,. Setting / = JCV^., we have 

\V*x,,ICV*y,^^g{x) - V],^^lCV*y,^^g{y)\ < {C{d) / e^'^'y^)\\g\\L.^Y.,,) ■ \\x ~ yV". 

□ 



33 



Lemma 16. Let X C M" compact and F : X ^R. If 



lim sup 

II7IK0 



\F{x + -f)-F{x)\ 



< C for all X e X, 



then F is globally Lipschitz with Lipschitz constant C . 

Proof. Note limsup||^||_^Q |F(,T + 7) — F(,t)|/[|7|| = lim^^o sup{|F(,x + 7) — F(a;)|/||7|| : ||7|| < 
7,7 7^ 0}. Thus given e > there is a A = /S.{e,x) > such that |F(a; + 7) — F(a;)|/||7|| < 
C + £ for all 7 7^ with ||7|| < A. Form an open cover of X as {-BA(e,a;) (2^) '■ ^ £ X}. By 
compactness of X we can find a finite subcover. 

Consider arbitrary x,y & X and write y = x + (note 7 is arbitrary from now on 
and need not satisfy ||7|| < A). Draw a line segment from x to x + 7; this line segment 
{x + : < 9 < 1} passes through a subcoUection of open balls from our finite subcover. 
Denote by X' the finite set of centres of the open balls in our subcoUection. 

We now trace out the line segment again, identifying a finite sequence of points yi and 
ball centres Xe as we go. Begin at x, set yo = x and choose an xq G X' so that x G -BA(e,a;o)- 
Now increase 6 until ||a;o — {x + 0'y)\\ = 0.9A(£,Xo). If a; + ^^7 lies in some -Ba(£,xi)! '"^^i ^ 
X',xi 7^ Xq, then set yi = x + 9'y; otherwise, increase 9 until a; + 6'7 lies in -BA(£,a:o) l~l-SA(e,a;i)) 
xi G X', xi 7^ Xq and set yi — x + ^7. Repeat the procedure: in general, we have a 
Hi £ -Ba(£,x^) and we increase 7 until \\xi — (y^ + ^7)|| = 0.9A(e, xi). If y£ + ^7 lies in some 
BA{e,xi+i),xe+i G X',X£+i X£, . . . ,xo, then set ye+i = ye + 9j; otherwise, increase 9 until 
yi + 9-f lies in 5A(e,x^) n 5a(£,x<+i), xg+i G X', xe+i 7^ xe, . . .,xo, and again set ye+i = ye + 9j. 
Finally we make a step from yL-i to |/l := a: + 7 where yL-i, a; + 7 G -BA(£,a;i,_i)- 



By construction, yo G BA{e,xo), Vt ^ ^a(£,x<.. 



.1) n 5a(£,:,,) for 



-BA{£,Xi_i)- Thus yd, ye+i G B^^cxe) for £ = 0, . . . , L 



1 < e < 

1, we may estimate 



L — 1, and yi G 



-F(x + 7)| 



L-l 

^F(y,)-F(y,+i) 

L-l 



L-l 



£=0 

= {C + e)\\yo - yL\\ 
= (C + ^)||7ll, 



where the penultimate equality follows since the ye are coUinear. As x,y & X were arbitrary 
the result follows. □ 
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